revert(marketing): remove landing hero positioning experiment by saddlepaddle · Pull Request #6155 · ParadevAI/Paradev

saddlepaddle · 2026-08-04T16:31:55Z

Summary

Closes out the landing-hero-positioning A/B test (PostHog experiment 386395) and removes all experiment code. Reverts the experiment wiring from #5832 and the flag bootstrap from #5884.

HeroSection renders the control copy unconditionally again (no flag read, no platform gating for copy selection)
Removed the bootstrap option from the marketing posthog.init (it existed only for instant, sticky hero-variant assignment)
Deleted hero-flag-bootstrap.ts (client-side SHA-1 variant assignment mirror)

Result (why we're closing)

After 2 weeks and ~7.8k exposures, download_clicked was flat: control 21.9% vs test 21.7%, 42% chance to win, credible interval [−9.3%, +7.6%] relative — which already excludes the pre-registered +10% MDE, so the test arm can't win. The PostHog experiment is stopped and marked inconclusive; the flag will be cleaned up after this deploys.

https://claude.ai/code/session_016SyQq825A17ZMGGDgyaoPE

Summary by cubic

Remove the landing-hero-positioning A/B test and revert the landing hero to the control copy. Closes PostHog experiment 386395 and simplifies the marketing analytics init.

Refactors
- HeroSection now always renders the control copy; removed flag reads and platform gating.
- Dropped bootstrap from marketing posthog.init; deleted apps/marketing/src/lib/analytics/hero-flag-bootstrap.ts.

^{Written for commit 411e676. Summary will update on new commits.}

Summary by CodeRabbit

Changes
- Simplified the marketing hero section to use consistent headline and subheadline content.
- Removed audience-based hero variations and platform-specific positioning.
- Updated hero animations and sizing to render directly from the standard content configuration.

Closes out the landing-hero-positioning A/B test (PostHog experiment 386395). Result was flat on download_clicked, so the control copy stays. Reverts the experiment wiring from #5832 and the flag bootstrap from #5884; the hero renders the control copy unconditionally again. Claude-Session: https://claude.ai/code/session_016SyQq825A17ZMGGDgyaoPE

coderabbitai · 2026-08-04T16:32:26Z

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: fcd96176-6c82-4791-9b0a-d45241adbb80

📥 Commits

Reviewing files that changed from the base of the PR and between d530b98 and 411e676.

📒 Files selected for processing (3)

apps/marketing/src/app/components/HeroSection/HeroSection.tsx
apps/marketing/src/instrumentation-client.ts
apps/marketing/src/lib/analytics/hero-flag-bootstrap.ts

💤 Files with no reviewable changes (2)

apps/marketing/src/instrumentation-client.ts
apps/marketing/src/lib/analytics/hero-flag-bootstrap.ts

📝 Walkthrough

Walkthrough

The marketing hero no longer uses PostHog-based positioning variants or platform detection. It uses static copy, and PostHog initialization no longer receives hero flag bootstrap data. The hero flag bootstrap module was deleted.

Changes

Hero experiment removal

Layer / File(s)	Summary
Static hero copy and rendering `apps/marketing/src/app/components/HeroSection/HeroSection.tsx`	`HeroSection` uses one static headline and subheadline configuration. Sizing, typewriter rendering, and subheadline output read directly from that configuration.
PostHog bootstrap cleanup `apps/marketing/src/instrumentation-client.ts`	PostHog initialization no longer imports or passes hero flag bootstrap data. The hero flag bootstrap module was removed.

Estimated code review effort: 2 (Simple) | ~10 minutes

Possibly related PRs

superset-sh/superset#5832: Introduces the hero A/B-testing changes that this PR removes.
superset-sh/superset#5884: Adds the hero experiment bootstrap integration removed here.
superset-sh/superset#5936: Extends the hero flag and mobile CTA experiment affected by this removal.

Suggested reviewers: kitenite

🚥 Pre-merge checks | ✅ 5

✅ Passed checks (5 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title clearly identifies the marketing experiment removal and follows conventional commit format.
Description check	✅ Passed	The description explains the change and rationale clearly, but it omits the template's testing section and checklist.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

✨ Finishing Touches

📝 Generate docstrings

Create stacked PR
Commit on current branch

🧪 Generate unit tests (beta)

Create PR with unit tests
Commit unit tests in branch close-landing-experiment

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

_{Comment @coderabbitai help to get the list of available commands.}

greptile-apps · 2026-08-04T16:34:14Z

Greptile Summary

Reverts the completed landing-hero positioning experiment and restores static control copy.

Removes platform and PostHog feature-flag selection from HeroSection.
Removes the experiment-specific PostHog bootstrap configuration.
Deletes the now-unused client-side hero variant assignment helper.

Confidence Score: 5/5

The PR appears safe to merge with no actionable regressions identified.

The experiment-specific rendering, bootstrap configuration, and assignment helper are removed together, while static hero rendering and standard cookie-backed analytics initialization remain intact.

Important Files Changed

Filename	Overview
apps/marketing/src/app/components/HeroSection/HeroSection.tsx	Restores unconditional control copy and removes the experiment’s platform and feature-flag dependencies without leaving stale references.
apps/marketing/src/instrumentation-client.ts	Removes only the hero experiment bootstrap while preserving PostHog persistence, consent handling, and general analytics configuration.
apps/marketing/src/lib/analytics/hero-flag-bootstrap.ts	Deletes the experiment-specific variant assignment helper after all of its consumers were removed.

_{Reviews (1): Last reviewed commit: "revert(marketing): remove landing hero p..." | Re-trigger Greptile}

github-actions · 2026-08-04T16:38:39Z

🧹 Preview Cleanup Complete

The following preview resources have been cleaned up:

✅ Neon database branch

Thank you for your contribution! 🎉

saddlepaddle temporarily deployed to preview August 4, 2026 16:32 — with GitHub Actions Inactive

saddlepaddle temporarily deployed to preview August 4, 2026 16:33 — with GitHub Actions Inactive

saddlepaddle merged commit df0cdc0 into main Aug 4, 2026
19 checks passed

saddlepaddle deleted the close-landing-experiment branch August 4, 2026 16:41

Kitenite mentioned this pull request Aug 9, 2026

docs(marketing): weekly changelog 2026-08-09 #6289

Merged

Navigation Menu

Repository navigation

revert(marketing): remove landing hero positioning experiment - #6155

revert(marketing): remove landing hero positioning experiment#6155
saddlepaddle merged 1 commit into
mainfrom
close-landing-experiment

saddlepaddle commented Aug 4, 2026 •

edited by coderabbitai Bot

Loading

Uh oh!

coderabbitai Bot commented Aug 4, 2026 •

edited

Loading

Walkthrough

Changes

Uh oh!

greptile-apps Bot commented Aug 4, 2026

Important Files Changed

Uh oh!

github-actions Bot commented Aug 4, 2026 •

edited

Loading

Uh oh!

Uh oh!

This branch was previously deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

saddlepaddle commented Aug 4, 2026 • edited by coderabbitai Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Result (why we're closing)

Summary by cubic

Summary by CodeRabbit

Uh oh!

coderabbitai Bot commented Aug 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Walkthrough

Changes

Uh oh!

greptile-apps Bot commented Aug 4, 2026

Greptile Summary

Confidence Score: 5/5

Important Files Changed

Uh oh!

github-actions Bot commented Aug 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🧹 Preview Cleanup Complete

Uh oh!

Uh oh!

This branch was previously deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

saddlepaddle commented Aug 4, 2026 •

edited by coderabbitai Bot

Loading

coderabbitai Bot commented Aug 4, 2026 •

edited

Loading

github-actions Bot commented Aug 4, 2026 •

edited

Loading